Temporal Decorrelation: A Theory of Lagged and Nonlagged Responses in the Lateral Geniculate Nucleus

Natural time-varying images possess signi cant temporal correlations when sampled frame by frame by the photoreceptors. These correlations persist even after retinal processing and hence, under natural activation conditions, the signal sent to the lateral geniculate nucleus is temporally redundant or ine cient. We explore the hypothesis that the LGN is concerned, among other things, with improving e ciency of visual representation through active temporal decorrelation of the retinal signal much in the same way that the retina improves e ciency by spatially decorrelating incoming images. Using some recently measured statistical properties of time-varying images, we predict the spatio-temporal receptive elds that achieve this decorrelation. It is shown that, because of neuronal nonlinearities, temporal decorrelation requires two response types, the lagged and nonlagged, just as spatial decorrelation requires on and o response types. The tuning and response properties of the predicted LGN cells compare quantitatively well with what is observed in recent physiological experiments.